Some Further Developments for Stick-breaking Priors: Finite and Infinite Clustering and Classification
نویسندگان
چکیده
SUMMARY. The class of stick-breaking priors and their extensions are considered in classification and clustering problems in which the complexity, the number of possible models or clusters, can be either bounded or unbounded. A conjugacy property for the ex tended stick-breaking prior is established which allows for informative characterizations of the priors under i.i.d. sampling, and which further enables an informative characterization of the posterior in the classification model. Such characterizations show how to develop Monte Carlo algorithms for efficient posterior computing. One implication is that it is pos sible to estimate infinite complexity mixture models subject to arbitrary stick-breaking priors.
منابع مشابه
When Can Finite Testing Ensure Infinite Trustworthiness?
In this paper we contribute to the general philosophical question as to whether empirical testing can ever prove a physical law. Problems that lead to this question arise under several contexts, and the matter has been addressed by the likes of Bayes and Laplace. After pointing out that a Bayesian approach is the proper way to address this problem, we show that the answ...
متن کاملAccelerated Variational Infinite Mixture Models
Infinite mixture models, such as the Dirichlet process mixture, are promising candidates for clustering applications where the number of clusters is unknown a priori. Due to computational considerations these models are unfortunately unsuitable for large scale data-mining applications. We propose a class of deterministic accelerated infinite mixture models that can routinely handle millions of ...
متن کاملInfinite Markov-Switching Maximum Entropy Discrimination Machines
In this paper, we present a method that combines the merits of Bayesian nonparametrics, specifically stick-breaking priors, and largemargin kernel machines in the context of sequential data classification. The proposed model employs a set of (theoretically) infinite interdependent large-margin classifiers as model components, that robustly capture local nonlinearity of complex data. The employe...
متن کاملGibbs Sampling Methods for Stick-Breaking Priors
A rich and exible class of random probability measures, which we call stick-breaking priors, can be constructed using a sequence of independent beta random variables. Examples of random measures that have this characterization include the Dirichlet process, its two-parameter extension, the two-parameter Poisson–Dirichlet process, nite dimensional Dirichlet priors, and beta two-parameter pro...
متن کاملVariational Inference for Stick-Breaking Beta Process Priors
We present a variational Bayesian inference algorithm for the stick-breaking construction of the beta process. We derive an alternate representation of the beta process that is amenable to variational inference, and present a bound relating the truncated beta process to its infinite counterpart. We assess performance on two matrix factorization problems, using a non-negative factorization model...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008